The processing of intimately familiar and unfamiliar voices: Specific neural responses of speaker recognition and identification.

Research has repeatedly shown that familiar and unfamiliar voices elicit different neural responses. But it has also been suggested that different neural correlates associate with the feeling of having heard a voice and knowing who the voice represents. The terminology used to designate these varying responses remains vague, creating a degree of confusion in the literature. Additionally, terms serving to designate tasks of voice discrimination, voice recognition, and speaker identification are often inconsistent creating further ambiguities. The present study used event-related potentials (ERPs) to clarify the difference between responses to 1) unknown voices, 2) trained-to-familiar voices as speech stimuli are repeatedly presented, and 3) intimately familiar voices. In an experiment, 13 participants listened to repeated utterances recorded from 12 speakers. Only one of the 12 voices was intimately familiar to a participant, whereas the remaining 11 voices were unfamiliar. The frequency of presentation of these 11 unfamiliar voices varied with only one being frequently presented (the trained-to-familiar voice). ERP analyses revealed different responses for intimately familiar and unfamiliar voices in two distinct time windows (P2 between 200-250 ms and a late positive component, LPC, between 450-850 ms post-onset) with late responses occurring only for intimately familiar voices. The LPC present sustained shifts, and short-time ERP components appear to reflect an early recognition stage. The trained voice equally elicited distinct responses, compared to rarely heard voices, but these occurred in a third time window (N250 between 300-350 ms post-onset). Overall, the timing of responses suggests that the processing of intimately familiar voices operates in two distinct steps of voice recognition, marked by a P2 on right centro-frontal sites, and speaker identification marked by an LPC component. The recognition of frequently heard voices entails an independent recognition process marked by a differential N250. Based on the present results and previous observations, it is proposed that there is a need to distinguish between processes of voice "recognition" and "identification". The present study also specifies test conditions serving to reveal this distinction in neural responses, one of which bears on the length of speech stimuli given the late responses associated with voice identification.

How do children with developmental language disorder extend novel nouns?

In this study, we investigated the ability of children with developmental language disorder (DLD) to extend nouns referring to different categories of novel objects. In a word extension task, we used several types of object entities (solid, animate, nonsolid, functional, and spatial relations) for which children needed to attend to diverse properties (shape, texture, role, or spatial relation) to decide category membership. We compared 15 school-aged children with DLD with typically developing (TD) children matched on either age or vocabulary. Our results indicate that children with DLD were impaired in extending novel words for nonsolid substances and relational objects, whereas age-matched TD children performed well for all object classes. Similar to children with DLD, TD children matched on language had difficulty in extending spatial relation categories. We also show that children with DLD needed more learning exemplars and relied more on shape-based information than TD children, especially for spatial configuration objects. Overall, our findings suggest that children are able to learn regularities between object properties and category organization and to focus on diverse features according to the object presented when extending novel nouns. They also provide clear evidence linking DLD to deficits in novel name generalization and word learning.

The Role of Low-frequency Neural Oscillations in Speech Processing: Revisiting Delta Entrainment.

Studies that use measures of cerebro-acoustic coherence have shown that theta oscillations (3-10 Hz) entrain to syllable-size modulations in the energy envelope of speech. This entrainment creates sensory windows in processing acoustic cues. Recent reports submit that delta oscillations (<3 Hz) can be entrained by nonsensory content units like phrases and serve to process meaning-though such views face fundamental problems. Other studies suggest that delta underlies a sensory chunking linked to the processing of sequential attributes of speech sounds. This chunking associated with the "focus of attention" is commonly manifested by the temporal grouping of items in sequence recall. Similar grouping in speech may entrain delta. We investigate this view by examining how low-frequency oscillations entrain to three types of stimuli (tones, nonsense syllables, and utterances) having similar timing, pitch, and energy contours. Entrainment was indexed by "intertrial phase coherence" in the EEGs of 18 listeners. The results show that theta oscillations at central sites entrain to syllable-size elements in speech and tones. However, delta oscillations at frontotemporal sites specifically entrain to temporal groups in both meaningful utterances and meaningless syllables, which indicates that delta may support but does not directly bear on a processing of content. The findings overall suggest that, although theta entrainment relates to a processing of acoustic attributes, delta entrainment links to a sensory chunking that relates to a processing of properties of articulated sounds. The results also show that measures of intertrial phase coherence can be better suited than cerebro-acoustic coherence in revealing delta entrainment.

Analogical reasoning in children with specific language impairment: Evidence from a scene analogy task.

Analogical reasoning is a human ability that maps systems of relations. It develops along with relational knowledge, working memory and executive functions such as inhibition. It also maintains a mutual influence on language development. Some authors have taken a greater interest in the analogical reasoning ability of children with language disorders, specifically those with specific language impairment (SLI). These children apparently have weaker analogical reasoning abilities than their aged-matched peers without language disorders. Following cognitive theories of language acquisition, this deficit could be one of the causes of language disorders in SLI, especially those concerning productivity. To confirm this deficit and its link to language disorders, we use a scene analogy task to evaluate the analogical performance of SLI children and compare them to controls of the same age and linguistic abilities. Results show that children with SLI perform worse than age-matched peers, but similar to language-matched peers. They are more influenced by increased task difficulty. The association between language disorders and analogical reasoning in SLI can be confirmed. The hypothesis of limited processing capacity in SLI is also being considered.

Verbal memory and verbal fluency tasks used for language localization and lateralization during magnetoencephalography.

OBJECTIVE: The aim of this study was to develop a presurgical magnetoencephalography (MEG) protocol to localize and lateralize expressive and receptive language function as well as verbal memory in patients with epilepsy. Two simple language tasks and a different analytical procedure were developed. METHODS: Ten healthy participants and 13 epileptic patients completed two language tasks during MEG recording: a verbal memory task and a verbal fluency task. As a first step, principal component analyses (PCA) were performed on source data from the group of healthy participants to identify spatiotemporal factors that were relevant to these paradigms. Averaged source data were used to localize areas activated during each task and a laterality index (LI) was computed on an individual basis for both groups, healthy participants and patients, using sensor data. RESULTS: PCA revealed activation in the left temporal lobe (300 ms) during the verbal memory task, and from the frontal lobe (210 ms) to the temporal lobe (500 ms) during the verbal fluency task in healthy participants. Averaged source data showed activity in the left hemisphere (250-750 ms), in Wernicke's area, for all participants. Left hemisphere dominance was demonstrated better using the verbal memory task than the verbal fluency task (F1,19=4.41, p=0.049). Cohen's kappa statistic revealed 93% agreement (k=0.67, p=0.002) between LIs obtained from MEG sensor data and fMRI, the IAT, electrical cortical stimulation or handedness with the verbal memory task for all participants. At 74%, agreement results for the verbal fluency task did not reach statistical significance. SIGNIFICANCE: Analysis procedures yielded interesting findings with both tasks and localized language-related activation. However, based on source localization and laterality indices, the verbal memory task yielded better results in the context of the presurgical evaluation of epileptic patients. The verbal fluency task did not add any further information to the verbal memory task as regards language localization and lateralization for most patients and healthy participants that would facilitate decision making prior to surgery.

REM sleep and emotional face memory in typically-developing children and children with autism.

Relationship between REM sleep and memory was assessed in 13 neurotypical and 13 children with Autistic Spectrum Disorder (ASD). A neutral/positive/negative face recognition task was administered the evening before (learning and immediate recognition) and the morning after (delayed recognition) sleep. The number of rapid eye movements (REMs), beta and theta EEG activity over the visual areas were measured during REM sleep. Compared to neurotypical children, children with ASD showed more theta activity and longer reaction time (RT) for correct responses in delayed recognition of neutral faces. Both groups showed a positive correlation between sleep and performance but different patterns emerged: in neurotypical children, accuracy for recalling neutral faces and overall RT improvement overnight was correlated with EEG activity and REMs; in children with ASD, overnight RT improvement for positive and negative faces correlated with theta and beta activity, respectively. These results suggest that neurotypical and children with ASD use different sleep-related brain networks to process faces.

The perceptual chunking of speech: a demonstration using ERPs.

In tasks involving the learning of verbal or non-verbal sequences, groupings are spontaneously produced. These groupings are generally marked by a lengthening of final elements and have been attributed to a domain-general perceptual chunking linked to working memory. Yet, no study has shown how this domain-general chunking applies to speech processing, partly because of the traditional view that chunking involves a conceptual recoding of meaningful verbal items like words (Miller, 1956). The present study provides a demonstration of the perceptual chunking of speech by way of two experiments using evoked Positive Shifts (PSs), which capture on-line neural responses to marks of various groups. We observed listeners׳ response to utterances (Experiment 1) and meaningless series of syllables (Experiment 2) containing changing intonation and temporal marks, while also examining how these marks affect the recognition of heard items. The results show that, across conditions - and irrespective of the presence of meaningful items - PSs are specifically evoked by groups marked by lengthening. Moreover, this on-line detection of marks corresponds to characteristic grouping effects on listeners' immediate recognition of heard items, which suggests chunking effects linked to working memory. These findings bear out a perceptual chunking of speech input in terms of groups marked by lengthening, which constitute the defining marks of a domain-general chunking.

Perceptual chunking and its effect on memory in speech processing: ERP and behavioral evidence.

We examined how perceptual chunks of varying size in utterances can influence immediate memory of heard items (monosyllabic words). Using behavioral measures and event-related potentials (N400) we evaluated the quality of the memory trace for targets taken from perceived temporal groups (TGs) of three and four items. Variations in the amplitude of the N400 showed a better memory trace for items presented in TGs of three compared to those in groups of four. Analyses of behavioral responses along with P300 components also revealed effects of chunk position in the utterance. This is the first study to measure the online effects of perceptual chunks on the memory trace of spoken items. Taken together, the N400 and P300 responses demonstrate that the perceptual chunking of speech facilitates information buffering and a processing on a chunk-by-chunk basis.

Face-specific impairment in holistic perception following focal lesion of the right anterior temporal lobe.

Recent studies have provided solid evidence for pure cases of prosopagnosia following brain damage. The patients reported so far have posterior lesions encompassing either or both the right inferior occipital cortex and fusiform gyrus, and exhibit a critical impairment in generating a sufficiently detailed holistic percept to individualize faces. Here, we extended these observations to include the prosopagnosic patient LR (Bukach, Bub, Gauthier, & Tarr, 2006), whose damage is restricted to the anterior region of the right temporal lobe. First, we report that LR is able to discriminate parametrically defined individual exemplars of nonface object categories as accurately and quickly as typical observers, which suggests that the visual similarity account of prosopagnosia does not explain his impairments. Then, we show that LR does not present with the typical face inversion effect, whole-part advantage, or composite face effect and, therefore, has impaired holistic perception of individual faces. Moreover, the patient is more impaired at matching faces when the facial part he fixates is masked than when it is selectively revealed by means of gaze contingency. Altogether these observations support the view that the nature of the critical face impairment does not differ qualitatively across patients with acquired prosopagnosia, regardless of the localization of brain damage: all these patients appear to be impaired to some extent at what constitutes the heart of our visual expertise with faces, namely holistic perception at a sufficiently fine-grained level of resolution to discriminate exemplars of the face class efficiently. This conclusion raises issues regarding the existing criteria for diagnosis/classification of patients as cases of apperceptive or associative prosopagnosia.

Luminance- and texture-defined information processing in school-aged children with autism.

According to the complexity-specific hypothesis, the efficacy with which individuals with autism spectrum disorder (ASD) process visual information varies according to the extensiveness of the neural network required to process stimuli. Specifically, adults with ASD are less sensitive to texture-defined (or second-order) information, which necessitates the implication of several cortical visual areas. Conversely, the sensitivity to simple, luminance-defined (or first-order) information, which mainly relies on primary visual cortex (V1) activity, has been found to be either superior (static material) or intact (dynamic material) in ASD. It is currently unknown if these autistic perceptual alterations are present in childhood. In the present study, behavioural (threshold) and electrophysiological measures were obtained for static luminance- and texture-defined gratings presented to school-aged children with ASD and compared to those of typically developing children. Our behavioural and electrophysiological (P140) results indicate that luminance processing is likely unremarkable in autistic children. With respect to texture processing, there was no significant threshold difference between groups. However, unlike typical children, autistic children did not show reliable enhancements of brain activity (N230 and P340) in response to texture-defined gratings relative to luminance-defined gratings. This suggests reduced efficiency of neuro-integrative mechanisms operating at a perceptual level in autism. These results are in line with the idea that visual atypicalities mediated by intermediate-scale neural networks emerge before or during the school-age period in autism.

Optimal eye-gaze fixation position for face-related neural responses.

It is generally agreed that some features of a face, namely the eyes, are more salient than others as indexed by behavioral diagnosticity, gaze-fixation patterns and evoked-neural responses. However, because previous studies used unnatural stimuli, there is no evidence so far that the early encoding of a whole face in the human brain is based on the eyes or other facial features. To address this issue, scalp electroencephalogram (EEG) and eye gaze-fixations were recorded simultaneously in a gaze-contingent paradigm while observers viewed faces. We found that the N170 indexing the earliest face-sensitive response in the human brain was the largest when the fixation position is located around the nasion. Interestingly, for inverted faces, this optimal fixation position was more variable, but mainly clustered in the upper part of the visual field (around the mouth). These observations extend the findings of recent behavioral studies, suggesting that the early encoding of a face, as indexed by the N170, is not driven by the eyes per se, but rather arises from a general perceptual setting (upper-visual field advantage) coupled with the alignment of a face stimulus to a stored face template.

ERP correlates of recognition memory in Autism Spectrum Disorder.

Recognition memory in autism spectrum disorder (ASD) tends to be undiminished compared to that of typically developing (TD) individuals (Bowler et al. 2007), but it is still unknown whether memory in ASD relies on qualitatively similar or different neurophysiology. We sought to explore the neural activity underlying recognition by employing the old/new word repetition event-related potential effect. Behavioural recognition performance was comparable across both groups, and demonstrated superior recognition for low frequency over high frequency words. However, the ASD group showed a parietal rather than anterior onset (300-500 ms), and diminished right frontal old/new effects (800-1500 ms) relative to TD individuals. This study shows that undiminished recognition performance results from a pattern of differing functional neurophysiology in ASD.

Localization of synchronous cortical neural sources.

Neural synchronization is a key mechanism to a wide variety of brain functions, such as cognition, perception, or memory. High temporal resolution achieved by EEG recordings allows the study of the dynamical properties of synchronous patterns of activity at a very fine temporal scale but with very low spatial resolution. Spatial resolution can be improved by retrieving the neural sources of EEG signal, thus solving the so-called inverse problem. Although many methods have been proposed to solve the inverse problem and localize brain activity, few of them target the synchronous brain regions. In this paper, we propose a novel algorithm aimed at localizing specifically synchronous brain regions and reconstructing the time course of their activity. Using multivariate wavelet ridge analysis, we extract signals capturing the synchronous events buried in the EEG and then solve the inverse problem on these signals. Using simulated data, we compare results of source reconstruction accuracy achieved by our method to a standard source reconstruction approach. We show that the proposed method performs better across a wide range of noise levels and source configurations. In addition, we applied our method on real dataset and identified successfully cortical areas involved in the functional network underlying visual face perception. We conclude that the proposed approach allows an accurate localization of synchronous brain regions and a robust estimation of their activity.

VEP contrast sensitivity responses reveal reduced functional segregation of mid and high filters of visual channels in autism.

Despite the vast amount of behavioral data showing a pronounced tendency in individuals with autism spectrum disorder (ASD) to process fine visual details, much less is known about the neurophysiological characteristics of spatial vision in ASD. Here, we address this issue by assessing the contrast sensitivity response properties of the early visual-evoked potentials (VEPs) to sine-wave gratings of low, medium and high spatial frequencies in adults with ASD and in an age- and IQ-matched control group. Our results show that while VEP contrast responses to low and high spatial frequency gratings did not differ between ASD and controls, early VEPs to mid spatial frequency gratings exhibited similar response characteristics as those to high spatial frequency gratings in ASD. Our findings show evidence for an altered functional segregation of early visual channels, especially those responsible for processing mid- and high-frequency spatial scales.

The effects of early and late night partial sleep deprivation on automatic and selective attention: An ERP study.

The link between decrease in levels of attention and total sleep deprivation is well known but the respective contributions of slow wave sleep (SWS) and rapid eye movement sleep (REM) is still largely unknown. The aim of this study was to characterize the effects of sleep deprivation during the SWS phase (i.e., early night sleep) and the REM phase (i.e., late night sleep) on tasks that tap automatic and selective attention; these two forms of attention were indexed respectively by "mismatch negativity" (MMN) and "negative difference" (Nd) event-related potential (ERP) difference waves. Ten young adult participants were subjected to a three-night sleep protocol. They were each received one night of full sleep (F), one night of sleep deprivation during the first half of the night (H1), and one night of sleep deprivation during the second half of the night (H2). MMN and Nd were recorded the following morning of each night during two auditory oddball tasks that tapped automatic and selective attention. The effect of sleep deprivation condition was assessed using ERP amplitude measures and standardized low-resolution electromagnetic tomography method (sLORETA). ERP results revealed significant MMN amplitude reduction over frontal and temporal recording areas following the H2 night compared to F and H1, indicating reductions in levels of automatic attention. In addition, Nd amplitude over the parietal recording area was significantly increased following the H2 night compared to F and H1. sLORETA findings show significant changes from F to H2 night in frontal cortex activity, decreasing during the automatic attention task but increasing during the selective attention task. No significant change in brain activity is observed after H1 night. The restoration of attention processes is mainly achieved during REM sleep, which confirms results from previous studies in rat models. The anterior cortex seems to be more sensitive to sleep loss, while the parietal cortex acts as a compensatory resource to restore cognitive performance in a task context.

Characterizing the spatio-temporal dynamics of the neural events occurring prior to and up to overt recognition of famous faces.

Although it is generally acknowledged that familiar face recognition is fast, mandatory, and proceeds outside conscious control, it is still unclear whether processes leading to familiar face recognition occur in a linear (i.e., gradual) or a nonlinear (i.e., all-or-none) manner. To test these two alternative accounts, we recorded scalp ERPs while participants indicated whether they recognize as familiar the faces of famous and unfamiliar persons gradually revealed in a descending sequence of frames, from the noisier to the least noisy. This presentation procedure allowed us to characterize the changes in scalp ERP responses occurring prior to and up to overt recognition. Our main finding is that gradual and all-or-none processes are possibly involved during overt recognition of familiar faces. Although the N170 and the N250 face-sensitive responses displayed an abrupt activity change at the moment of overt recognition of famous faces, later ERPs encompassing the N400 and late positive component exhibited an incremental increase in amplitude as the point of recognition approached. In addition, famous faces that were not overtly recognized at one trial before recognition elicited larger ERP potentials than unfamiliar faces, probably reflecting a covert recognition process. Overall, these findings present evidence that recognition of familiar faces implicates spatio-temporally complex neural processes exhibiting differential pattern activity changes as a function of recognition state.

From upright to upside-down presentation: a spatio-temporal ERP study of the parametric effect of rotation on face and house processing.

BACKGROUND: While there is a general agreement that picture-plane inversion is more detrimental to face processing than to other seemingly complex visual objects, the origin of this effect is still largely debatable. Here, we address the question of whether face inversion reflects a quantitative or a qualitative change in processing mode by investigating the pattern of event-related potential (ERP) response changes with picture plane rotation of face and house pictures. Thorough analyses of topographical (Scalp Current Density maps, SCD) and dipole source modeling were also conducted. RESULTS: We find that whilst stimulus orientation affected in a similar fashion participants' response latencies to make face and house decisions, only the ERPs in the N170 latency range were modulated by picture plane rotation of faces. The pattern of N170 amplitude and latency enhancement to misrotated faces displayed a curvilinear shape with an almost linear increase for rotations from 0 degrees to 90 degrees and a dip at 112.5 degrees up to 180 degrees rotations. A similar discontinuity function was also described for SCD occipito-temporal and temporal current foci with no topographic distribution changes, suggesting that upright and misrotated faces activated similar brain sources. This was confirmed by dipole source analyses showing the involvement of bilateral sources in the fusiform and middle occipital gyri, the activity of which was differentially affected by face rotation. CONCLUSION: Our N170 findings provide support for both the quantitative and qualitative accounts for face rotation effects. Although the qualitative explanation predicted the curvilinear shape of N170 modulations by face misrotations, topographical and source modeling findings suggest that the same brain regions, and thus the same mechanisms, are probably at work when processing upright and rotated faces. Taken collectively, our results indicate that the same processing mechanisms may be involved across the whole range of face orientations, but would operate in a non-linear fashion. Finally, the response tuning of the N170 to rotated faces extends previous reports and further demonstrates that face inversion affects perceptual analyses of faces, which is reflected within the time range of the N170 component.

Impaired face processing in autism: fact or artifact?

Within the last 10 years, there has been an upsurge of interest in face processing abilities in autism which has generated a proliferation of new empirical demonstrations employing a variety of measuring techniques. Observably atypical social behaviors early in the development of children with autism have led to the contention that autism is a condition where the processing of social information, particularly faces, is impaired. While several empirical sources of evidence lend support to this hypothesis, others suggest that there are conditions under which autistic individuals do not differ from typically developing persons. The present paper reviews this bulk of empirical evidence, and concludes that the versatility and abilities of face processing in persons with autism have been underestimated.

Can spectro-temporal complexity explain the autistic pattern of performance on auditory tasks?

To test the hypothesis that level of neural complexity explain the relative level of performance and brain activity in autistic individuals, available behavioural, ERP and imaging findings related to the perception of increasingly complex auditory material under various processing tasks in autism were reviewed. Tasks involving simple material (pure tones) and/or low-level operations (detection, labelling, chord disembedding, detection of pitch changes) show a superior level of performance and shorter ERP latencies. In contrast, tasks involving spectrally- and temporally-dynamic material and/or complex operations (evaluation, attention) are poorly performed by autistics, or generate inferior ERP activity or brain activation. Neural complexity required to perform auditory tasks may therefore explain pattern of performance and activation of autistic individuals during auditory tasks.

Exploring the functional architecture of person recognition system with event-related potentials in a within- and cross-domain self-priming of faces.

In this paper, we explored the functional properties of person recognition system by investigating the onset, magnitude, and scalp distribution of within- and cross-domain self-priming effects on event-related potentials (ERPs). Recognition of degraded pictures of famous people was enhanced by a prior exposure to the same person's face (within-domain self-priming) or name (cross-domain self-priming) as compared to those preceded by neutral or unrelated primes. The ERP results showed first that the amplitude of the N170 component to famous face targets was modulated by within- and cross-domain self-priming, suggesting not only that the N170 component can be affected by top-down influences but also that this top-down effect crosses domains. Second, similar to our behavioral data, later ERPs to famous faces showed larger ERP self-priming effects in the within-domain than in the cross-domain condition. In addition, the present data dissociated between two topographically and temporally overlapping priming-sensitive ERP components: the first one, with a strongly posterior distribution arising at an early onset, was modulated more by within-domain priming irrespective whether the repeated face was familiar or not. The second component, with a relatively uniform scalp distribution, was modulated by within- and cross-domain priming of familiar faces. Moreover, there was no evidence for ERP-induced modulations for unfamiliar face targets in the cross-domain condition. Together, our findings suggest that multiple neurocognitive events that are possibly mediated by distinct brain loci contribute to face priming effects.